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Forward 


Report  developed  under  topic  #A09A-T009,  contract  W911NF-09-C-0153.  Applied  Quantum 
Technologies  along  with  its  university  partner  Duke  University  conducted,  during  a  Phase  I  STTR 
contract,  the  design  of  a  coded-aperture  snapshot  Raman  imager.  The  snapshot  system  design  provides 
dwell  times  much  shorter  than  conventional  slit-hased  or  tunahle-filter  based  spectral  imagers.  A  deep 
ultra-violet  or  short-wave  infrared  excitation  source  allows  for  minimal  sample  fluorescence,  making  the 
system  able  to  cope  with  target  signatures  in  a  wide  variety  of  backgrounds.  While  the  majority  of  Raman 
systems  available  are  point-based,  having  imaging  capabilities  permits  wide  area  coverage  at  a  fraction  of 
the  time  of  point-based  systems.  By  utilizing  compressed  sensing  algorithms,  large  amounts  of  spatial  and 
spectral  information  can  be  acquired  using  the  limited  pixel  counts  available  in  detector  arrays. 

Statement  of  the  problem  studied 

Applied  Quantum  Technologies  along  with  its  university  partner  Duke  University 
conducted,  during  a  Phase  I  STTR  contract,  the  design  of  a  coded- aperture  snapshot  Raman 
imager.  The  snapshot  system  design  provides  dwell  times  much  shorter  than  conventional  slit- 
based  or  tunable-filter  based  spectral  imagers.  A  deep  ultra-violet  or  short-wave  infrared 
excitation  source  allows  for  minimal  sample  fluorescence,  making  the  system  able  to  cope  with 
target  signatures  in  a  wide  variety  of  backgrounds.  While  the  majority  of  Raman  systems 
available  are  point-based,  having  imaging  capabilities  permits  wide  area  coverage  at  a  fraction  of 
the  time  of  point-based  systems.  By  utilizing  compressed  sensing  algorithms,  large  amounts  of 
spatial  and  spectral  information  can  be  acquired  using  the  limited  pixel  counts  available  in 
detector  arrays. 

In  our  designs  we  considered  two  applications  guided  by  the  input  from  the  following 
Army  Scientists:  Wayne  Antesberger  -  NVESD,  Frank  DeLucia  -  ARL/ Aberdeen,  Henry  Everitt 
-  AMSRD,  and  Augustus  W.  Fountain  -  Edgewood  Arsenal.  The  applications  considered  in  the 
design  and  modeling  effort  were:  a  SWIR  explosives  detection  for  countermine/IED  and  a  UV 
explosive  and  biohazard  detection  system.  To  estimate  the  feasibility  of  a  DUV  or  SWIR  system, 
four  critical  parameters  were  evaluated:  Raman  photon  generation,  imaging  sensor 
characteristics,  excitation  laser  characteristics,  and  solar  background. 

Summary  of  the  most  important  results 

Phase  I  Accomplishments 

•  Created  a  list  of  absolute  cross-sections  for  several  Raman  bands  in  common  explosives 
and  nerve  agents. 

•  Found  suitable  near  infrared  (SWIR)  and  deep  ultraviolet  (DUV)  laser  sources  for  the 
Raman  Imager. 

•  Compared  Raman  photons  generated  in  the  SWIR  and  the  DUV  by  available  laser 
sources. 

•  Calculated  the  number  of  background  photons  in  sunlight  that  established  the  background 
limited  signal  to  noise  in  the  Raman  Imager. 

•  Compared  performance  of  commercially  available  SWIR  and  DUV  imaging  detectors. 

•  Selected  DUV  Raman  Imager  based  on  comparison  of  expected  signal  to  noise  of  the 
examined  systems. 
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•  Optical  designs  of  a  dual  disperser  and  a  single  disperser  were  generated  and  the  single 
disperser  was  selected  for  the  final  optical  design. 

•  A  MATLAB  simulator  was  created  to  model  the  performance  of  the  optical  architecture. 

•  The  simulator  was  used  to  evaluate  the  performance  of  the  reconstruction  algorithms  and 
the  impact  of  multiplexing  of  data. 

•  An  analysis  of  the  impact  of  noise  on  the  performance  of  the  imaging  spectrometer  was 
conducted. 


Raman  Detection  Model: 


To  model  Raman  radiation  received  from  an  object  at  a  range  r  at  wavelength  of  Xq,  we  use  the 
equation 

P(z,A,)  =  C,^^^^^exp[-][aJz\A,)  +  a^(z\A,)  +  aM\^R)  +  (X,(z\A,)W} 


where  |3r  is  the  Raman  backscatter  coefficient, 


dQ. 


ai.1 

Xo  is  the  laser  wavelength,  Xr  is  the  Raman  scattered  wavelength,  a  is  the  extinction  coefficient, 
0  is  the  scattering  angle,  m  indicates  molecular  effects  and  p  is  scattering  by  particles.  There  is 
also  elastic  scattered  light  (Rayleigh)  in  the  return  given  by 

P(z,\)  =  C,^ - - ^exp{-2j[aJz',/lo)  +  a^(z',/lo)]Jz'} 

Z  0 

The  absolute  cross-sections  of  several  Raman  bands  of  common  explosives 


Table  1:  Raman  cross-section  of  common  explosives 


Explosive 

UN 

TATP 

PETN 

RDX 

TNT 

Kr  cm'^ 

1050 

1010 

2992 

889 

1290 

887 

1340 

?io  nm 

Cross  section  a  [cm^/molecule  x  sr] 

248 

8.7X10'^* 

— 

O.OXIO'"® 

2.4X10'"'’ 

1.0X10'"" 

— 

9.8X10'"” 

266 

2.2X10'^* 

— 

5.3X10'"'’ 

1.9X10'"'’ 

3.4X10'"'’ 

<1.0X10'"" 

4.3X10'"” 

355 

1.6X10-"'’ 

3.6X10'"“ 

9.9X10'"“ 

3.9X10'"“ 

8.6X10'"“ 

7.0X10'"* 

6.0X10'"“ 

500 

— 

— 

4.1X10'"* 

520 

5.2X10""“ 

8.0X10'"* 

2.0X10'"“ 

6.0X10'"* 

3.5X10'"“ 

6.0X10'"* 

532 

3.9X10""“ 

7.1X10'"* 

8.2X10'"“ 

6.8X10'"* 

1.7X10'"“ 

9.4X10'"" 

4.9X10'"* 

625 

6.8X10'"* 

3.1X10'"* 

3.8X10'"* 

3.4X10'"* 

8.0X10'"* 

5.0X10'"" 

2.0X10'"* 

W avelength  enhancement-  actual  versus  non-resonant  model 

Kr248/Kr625 

1279.4 

— 

260.5 

70.6 

125.0 

— 

490.0 

(625/248)^ 

40.3 

40.3 

40.3 

40.3 

40.3 

40.3 

40.3 

4 


Final  Report  Contract  W91 1NF-09-C-0153 


Applied  Quantum  Technologies,  Inc. 


Table  2  Raman  cross-sections  of  common  nerve  agents 


Nerve 

Agent 

GA 

GB 

GD 

GF 

DIMP 

Kr  cm'^ 

2195 

724 

729-1-751 

758 

718 

Xo  nm 

Cross  section  a  [cm^/molecule  x  sr] 

248 

1.025X10-^’ 

2X10'^* 

3.35X10'^* 

2.35X10'^* 

2.52X10'^* 

262 

3X10'^* 

1.3X10-^® 

1.6X10'^'^ 

1.55X10'^* 

— 

363.8 

5.3X10'^® 

3.2X10'^^ 

— 

— 

4.3X1 0'^'" 

457.9 

1.8X10'^'^ 

3.2X10'^^ 

— 

— 

1.4X10'^^ 

488 

1.3X10'^® 

8.0X10'^'’ 

— 

— 

1.3X10'^^ 

514.5 

7.5X10'^“ 

S.OXIO'^” 

— 

— 

7.3X10-^'’ 

785 

1.5X10'^'’ 

1.5X10-^° 

I.SXIO-^” 

LOXIO'^” 

1.3X10-^'’ 

W avelength  enhancement-  actual  versus  non-resonant  model 

Kr248/Kr785 

683.3 

133.3 

223.3 

235.0 

193.8 

(785/248f 

100.4 

100.4 

100.4 

100.4 

100.4 

From  the  data  in  Table  2,  we  selected  a  prototypical  molecule,  the  nerve  agent  GA  (Tabun),  with 
the  following  molecular  parameters.  Table  3,  for  use  in  our  modeling  calculations: 


Table  3:  Sample  Parameters 


Parameter 

Units 

UV  Value 

SWIR 

Value 

Molecular  Weight 

Daltons  (g/mole) 

140.1 

140.1 

Liquid  Density 

g/cm^ 

1 

1 

Molecular  Density 

Molecules/cm^ 

4.30  X  10'^' 

4.30  X  10'^' 

Penetration  Depth 

mm 

0.1 

0.1 

Illuminated  Area 

cm^ 

6.25  X  lO'* 

6.25  X  lO'® 

Molecules  illuminated 

Molecular  area 

4.30  X  10'^^ 

4.30  X  10'^^ 

density 

Excitation 

nm 

248 

1064 

Wavelength 

Raman  cross  section 

cm7sr/molecule 

1.03  X  10'^’ 

4.44  X  10'^' 

Raman  Generation 

Fraction 

4.41  X  10'* 

1.91  X  10'" 

Prohahility 

The  laser  wavelengths  were  chosen  to  allow  for  a  fluorescence-free  background  by  either  going 
into  the  deep-UV,  or  into  the  short-wave  infrared.  The  combination  of  the  scaling  of  the 
Raman  cross-section  and  the  pre-resonance  enhancement  provides  a  2300x  increase  in  the 
Raman  photon  generation  probability  for  the  molecule  GA.  Assuming  no  pre-resonant 
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enhancement  would  lead  to  a  338x  increase  in  probability. 

Laser  Source 

The  excitation  wavelength  of  a  Raman  system  is  critical,  and  there  have  been  many 
studies  comparing  the  performance  of  systems  at  different  wavelengths.  Near- infrared  diode 
lasers  (785-850  nm)  are  frequently  used  in  laboratory  Raman  settings  due  to  the  decreased 
fluorescence  of  longer  wavelength  excitation,  however  many  chemicals  encountered  in  real- 
world  environments  like  paint  can  exhibit  strong  fluorescence  with  NIR  excitation.^  Fourier- 
transform  Raman  spectroscopy  with  1064  nm  excitation  is  a  well-developed  technique  that  is 
free  of  fluorescence  by  the  longer  choice  of  wavelength—  moving  the  Raman  spectra  to  the  red 
side  of  the  sample  fluorescence.  The  other  way  to  reduce  sample  fluorescence  is  to  go  into  the 
deep-UV,  hence  moving  the  Raman  spectra  to  the  blue  side  of  the  fluorescence  emission.  Work 
at  Brookhaven  National  Laboratory  has  established  the  need  to  go  below  250  nm  to  ensure  a 
fluorescence-free  background  for  a  variety  of  substrates  and  interferents.^ 

A  thorough  market  survey  of  both  NIR/SWIR  and  DUV  lasers  was  conducted  to 
determine  the  best  combination  of  sensitivity,  power,  and  size.  NIR/SWIR  diode  lasers  have  very 
high  efficiencies;  however  their  inability  to  be  pulsed  without  severely  reducing  their  average 
power  levels  makes  them  difficult  to  cope  with  the  background  solar  radiation  will  be  discussed 
later.  Q-switched  solid-state  lasers  at  1064  nm  have  high  peak  powers,  however  their  pulse 
energies  are  <1  ml  for  portable  systems  (power  draw  <  100  W,  weight  <10  kg).  Giant-pulse 
lasers  for  laser-induced  breakdown  spectroscopy  have  high  pulse  energies,  but  their  extreme 
weight  and  power  requirements  make  them  not  suitable  for  portable  applications.  In  the  DUV  the 
two  laser  types  used  for  Raman  are  hollow  cathode  gas  lasers  and  excimer  lasers.  The  excimers 
have  very  high  energy  pulses,  but  the  gas  changing  requirements  and  bulky  power  supplies 
needed  to  power  them  make  them  not  appealing  for  this  application.  The  hollow-cathode  lasers 
from  Photon  Systems  Inc.  have  a  low  power  output  compared  to  the  NIR/SWIR  lasers,  however 
the  increased  Raman  scattering  efficiency  and  reduced  solar  background  makes  them  an 
appealing  choice  for  portable  systems. 


Table  4:  Parameters  for  Laser  Sources  for  the  UV  and  NIR/SWIR 


NIR/SWIR 

Lasers 

W avelength  nm 

Output  W 

Input  W 

Weight  kg 

Edmund  Optics  NTS  37 1 

785 

0.45 

10 

1.1 

Edmund  Optics  NTS  372 

808 

0.45 

10 

1.1 

Edmund  Optics  NTS  373 

976 

0.45 

10 

1.1 

PD-LD  Luxx  Master 

976 

2 

5.6 

1 

Crystal  Laser  QIR- 1064- 1000 

1064 

1 

60 

___ 

Picoquant  Nanio 

1064 

25 

1.5  X  10^ 

29 

Ultraviolet 
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Lasers 

W  avelength 

Output  W 

Input  W 

Weight  kg 

Photon  Systems 

248 

0.5  mW 

10 

3.6 

Coherent  Sabre  MotoFreD 

248.2 

300  mW 

55  X  10^ 

311 

From  the  list  of  available  sources,  Table  4,  the  design  model  was  given  the  following  set  of 
source  parameters.  Table  5,  showing  the  increased  ability  of  the  DUV  system  to  generate  Raman 
photons  for  the  chemical  analyzed  earlier. 

Table  5:  Source  Parameters 


Parameter 

Units 

Photon  Systems 
DUV  Laser 

Crystal  Laser 

NIR/SWIR 

Laser 

Pulse  Power 

mW 

0.5 

1.5x10* 

Pulse  Width 

|jsec 

40 

0.02 

Pulse  Energy 

pj 

20 

300 

Beam  Diameter 

mm 

3 

3 

W  avelength 

nm 

248.6 

1064 

Energy/photon 

w 

8.00  X  lO'*" 

1.86x10'** 

Elux 

Photons/pulse 

2.5x  10‘" 

1.61x10** 

Raman  photons  generated  for 
sample  parameters  of  Table  3 

Raman 

photons/pulse 

1.10x10* 

3.08x10* 

Total  Power  Consumption 

W 

10 

40 

Solar  Background 

The  Raman  spectrum  must  be  detected  in  the  presence  of  sunlight  thus  a  key  parameter  analyzed 
is  the  level  of  background  solar  radiation  in  the  two  spectral  bands  being  investigated.  Figure  1. 
We  estimate  the  background  level  of  sunlight  in  the  optical  bandwidth  of  the  expected  Raman 
signal.  Table  6  gives  the  parameters  used  to  establish  the  background  parameters  used  to 
evaluate  the  background-limited  signal  to  noise. 
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ASTM  G 1 73-03  Reference  Spectra 


Wavelength  nm 

Figure  1:  Solar  Radiation  Spectrum  at  the  earth’s  surface^ 


From  Table  6  the  number  of  background  photons  generated  is  comparable  to  the  NIR/SWIR 
Raman  photon  generation  of  Table  4  for  a  1  cm  area.  For  point-based  systems  where  the  laser 
would  be  focused  to  a  diffraction-limited  spot,  this  amount  of  background  could  be  tolerated. 
However,  for  our  imaging  requirements,  the  amount  of  solar  radiation  would  severely  hinder  the 
coverage  area  and  the  dynamic  range  of  the  instrument. 


Table  6:  Background  parameters  for  1064  nm  excitation 


Parameter 

Units 

Value 

Spectral  Energy  Density 

W/m"^/nm 

0.6 

Bandwidth 

nm 

0.5 

Energy 

W/m^ 

0.3 

Rayleigh  Scattering 

Scattering  efficiency 

0.01 

Background  Photon  Density 

Photons/cm^/sec 

1.6  X  10^^ 

Background  Photons/pulse  (20  ns) 

Photons/cm  /pulse 

3.21  X  10^ 

Imaging  Detectors 

The  standoff  nature  of  the  proposed  system  creates  a  difficult  detection  problem,  as  the 
spectral  region  of  the  proposed  system  is  in  one  of  the  atmospheric  transmission  bands  of  the 
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short-wave  infrared  (SWIR).  Due  to  the  low  efficiency  of  the  Raman  scattering  process,  the 
background  radiation  can  overwhelm  the  weak  Raman  signal.  The  UV  range  is  appealing  in  this 
regard  as  upper  atmospheric  absorption  by  oxygen  and  ozone  eliminate  almost  all  radiation  in  the 
Raman  shifted  range  of  a  248  nm  excitation  source. 

In  order  to  increase  the  ratio  of  Raman  to  background  signal,  time  gating  can  be  used.  By 
using  a  pulsed  laser  and  detection  system,  this  ratio  can  be  increased  by  many  orders  of 
magnitude.  Detector  array  systems  have  been  analyzed  in  the  Phase  I  feasibility  study  for  the 
NIR/SWIR  and  UV,  Table  8  and  Table  7.  In  the  NIR/SWIR  a  non-intensified  Indium- Gallium- 
Arsenide  (InGaAs)  focal  plane  array  is  the  most  common  technology,  and  one  company  makes 
an  intensified  detector  array  using  an  Indium  Phosphide  (InP)/InGaAs  photocathode.  The  non- 
intensified  cameras  are  a  more  mature  technology,  but  have  a  disadvantage  in  that  the  data  must 
be  readout  with  each  pulse  of  the  excitation  laser.  The  readout  noise  of  the  camera  will  severely 
impact  the  sensitivity  of  the  system.  By  averaging  multiple  shots  this  effect  can  be  reduced, 
however  the  signal  still  must  relatively  strong  to  do  this. 

Intensified  cameras  have  two  advantages  over  non-intensified  cameras—  amplification  of 
photoelectrons  before  they  are  readout  by  circuitry,  and  the  ability  to  gate  the  accumulation  of 
photoelectrons.  In  the  UV  a  variety  of  intensified  cameras  are  produced  by  Andor,  Hamamatsu, 
and  Princeton  Instruments  with  excellent  readout  noise  statistics  and  cooling  options,  shown  in 
Table  8.  The  only  intensified  NIR/SWIR  camera  that  was  found  that  would  work  with  1064 
excitation  had  no  cooling  making  multiple  pulse  averaging  on  the  sensor  not  feasible. 


Table  7:  NIR/SWIR 


NIR/SWIR 

Cameras/Sensors 

Pixels 

Pixel 

Size 

pm 

Well 

Capacity 

ke' 

Readout 
Noise  e' 

Dark 

Current 

e/pixel/s 

QE 

%@II00 

nm 

NEI 

(p/cm^/s 

) 

DR 

dB 

Hamamatsu 

SI 0747-0909 

512x512 

24x24 

200ke- 

30 

20 

76 

Noblepeak  Triwave 
CC701 

640x480 

10x10 

7 

3.510'* 

59 

Intevac 

LIVAR  500 

640x480 

12x12 

o 

O' 

25 

1x10^ 

FLIR  SC2500 

320X256 

30 

3500 

150 

150 

70 

Goodrich 

SU640SDWH- 

1.7RT 

640x480 

25x25 

800 

300 

65 

2.5x10® 

68 

Xenics  Xeva  1.7- 
640 

640x512 

20x20 

7-14  A/D  counts 

XenicsXeva2.5320 

320x256 

30x30 

6  A/D  counts 
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Table  8:  UV  Detectors 


UV 

Cameras/Sensors 

Pixels 

Pixel 

Size  nm 

Well 

Capacity  ke' 

Readout 

Noise  e' 

Dark  Current 
eVp/s 

QE  %@250 
nm 

Hamamatsu  S 10141- 
1109S 

2048x506 

12x12 

75 

4 

50  (0  C) 

50 

Intevac  Microvista 
UV 

1280x102 

4 

10.8x10. 

8 

40 

30 

150 

45 

Sarnoff  CAMS  12- 
UV 

512x512 

18x18 

100 

65 

Alta  E42-UV 

2048x204 

8 

13.5x13. 

5 

100 

10 

200 

60 

Andor  DV420-UV 

1024-255 

26x26 

465 

4 

65 

Andor  DH7 12 

512X512 

24x24 

4 

1 

27 

The  high  gain  (1000)  and  low-noise  (equivalent  background  radiation  of  0.06  photoe-/s)  of  the 
Andor  DH712  allows  for  much  higher  sensitivity  detection  than  by  any  of  the  NIR/SWIR 
cameras.  The  detector  array  performance  combined  with  the  higher  Raman  photon  generation 
rate,  smaller  power  supply  requirements,  and  lack  of  solar  background  radiation,  led  to  the 
decision  to  pursue  a  DUV-based  system. 

System  Measurement  Model 

New  system  models  were  explored  to  address  two  issues  of  previous  CASSI  designs— 
spatial/spectral  resolution  trade-offs,  and  computation  time.  In  a  CASSI  system,  a  limited 
number  of  multiplexed  measurements  of  an  unknown  data-cube  are  used  to  infer  the  entire  data- 
cube  by  exploiting  the  sparsity  of  the  data-cube  on  some  mathematical  basis.  The  compression 
ratio  of  the  system—  ratio  of  measurements  made  to  data-cube  elements  reconstructed,  is  limited 
by  things  like  the  noise  in  the  measurement  system,  and  the  degree  of  sparsity  in  the  data-cube. 
The  resultant  system  still  has  a  limited  number  of  spatial  and  spectral  channels,  resulting  in 
limited  spatial  and  spectral  resolutions.  In  Raman  spectroscopic  applications,  the  high  spectral 
resolution  required  makes  the  implementation  of  a  snapshot  CASSI  system  problematic. 

Initially,  the  use  of  a  multi-aperture  CASSI  system  was  proposed  as  a  way  to  increase  the 
spatial  and  spectral  resolution  of  the  system.  By  providing  a  more  diverse  set  of  projections  of 
the  data-cube,  it  was  estimated  that  system  performance  would  be  increased.  This  was  the 
measurement  model  that  was  investigated  by  the  University  subcontractor. 

A  number  of  issues  with  the  multi-aperture  approach  were  identified  during  the  system 
modeling  feasibility  analysis: 

1)  Reduced  system  aperture-  the  weak  nature  of  Raman  scattering  requires  a  large 
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aperture  size  to  provide  enough  photons  for  the  imaging  detectors.  Having  a  multi-aperture 
system  with  large  (4-6”)  apertures  is  not  feasible  due  to  the  size,  weight,  and  cost  of  the  optic, 
along  with  the  difficulty  of  routing  all  of  the  light  to  a  single  focal  plane. 

2)  Limited  pixel  count-  large  pixel  count  arrays  were  not  found  to  be  available  in  the 
spectral  ranges  (UV  and  SWIR)  required  to  be  in  a  fluorescence-free  region,  limiting  the  final 
system  spatial  and  spectral  resolutions. 

A  more  appealing  approach  that  will  be  used  in  Phase  II  is  the  use  of  multi-resolution, 
multi-frame  processing  model.  The  snapshot  processing  approach  will  be  implemented  along 
with  a  multi-frame  processing  approach  that  will  be  used  to  enhance  the  spatial  and  spectral 
resolution  of  the  resultant  output.  The  system  will  be  able  to  provide  rapid  scanning  of  an  area 
with  coarse  resolution,  which  can  then  be  enhanced  by  taking  multiple  images  of  a  region  of 
interest  with  the  CASSI  platform  dithering  or  a  slight  movement  of  the  coded- aperture.  Some 
initial  work  done  at  Duke  University  using  this  approach  is  shown  in  the  Related  Work  section. 

Imaging  Spectrometer  Design 

There  are  two  frequently  used  disperser  designs  that  can  be  implemented  in  a  CASSI 

system: 

Dual  Disperser:  A  dual  disperser  design  where  the  source  is  imaged  through  two  sequentially 
dispersive  arms  arranged  in  opposition  so  that  the  dispersion  in  the  second  arm  cancels  the 
dispersion  introduced  by  the  first  arm.  A  coded  aperture  is  placed  between  the  two  arms. 
Recovery  of  the  datacube  from  the  detector  measurement  is  performed  using  an  expectation- 
maximization  method  designed  for  hyperspectral  images.  Such  a  design  applies  spatially 
varying,  spectral  filter  functions  with  narrow  features.  Through  these  filters,  the  detector 
measures  a  spectral  projective  measurement  of  the  datacube.  The  dual  disperser  sacrifices 
spatial  information  to  gain  spectral  information  about  the  datacube.  The  use  of  multiple 
dispersers  reduces  the  sensitivity  of  the  total  system  due  to  the  increased  number  of  optical 
elements  and  also  increases  the  alignment  requirements  of  the  system.  A  useful  property  of 
the  design  is  that  the  measurement  resembles  the  scene,  making  it  easy  to  focus  the  camera  on 
objects  in  the  scene. 

Single  Disperser:  A  single  disperser  coded  aperture  snapshot  imaging  spectrometer,  as  shown 
in  Figure  2, 
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Figure  2:  Single  disperser  typical  design 


consists  of  an  imaging  lens  that  illuminates  the  aperture  code  and  a  pair  of  relay  lenses  that  relay  the 
image  from  the  plane  of  the  aperture  code  to  the  detector  through  a  dispersive  element  placed 
between  them.  The  single  disperser  does  not  directly  measure  each  voxel  in  the  desired  three- 
dimensional  datacube.  It  collects  a  small  number  (relative  to  the  size  of  the  datacube)  of  coded 
measurements  and  a  sparse  reconstruction  method  is  used  to  estimate  the  datacube  from  the  noisy 
projections.  The  instrument  disperses  spectral  information  from  each  spatial  location  in  the  scene 
over  a  large  area  across  the  detector;  thus,  spatial  and  spectral  information  from  the  scene  is 
multiplexed  on  the  detector.  A  raw  measurement  of  a  scene  on  the  detector  rarely  reveals  spatial 
structure  of  the  scene  and  makes  block  processing  more  challenging.  The  use  of  a  single  disperser 
increases  the  sensitivity  of  the  system  and  is  our  choice  for  initial  designs. 

The  conclusion  drawn  from  the  design  and  modeling  conducted  during  Phase  I  was  to 
limit  our  attention  in  Phase  II  to  the  design  and  construction  of  a  UV  Raman  imager  based  on 
Coded-Aperture  Snapshot  Spectral  Imaging  (CASSI)  technology.  The  CASSI  technology  offers 
two  possible  disperser  designs  a  dual  disperser,  and  a  single  disperser.  Initial  designs  focused  on 
a  dual  disperser  design,  which  was  used  for  the  signal  processing  modeling,  however  the 
underlying  math  can  be  translated  to  a  single  disperser  approach  in  Phase  II  with  minimal  effort. 
Modeling  of  system  performance  conducted  in  Phase  I  has  led  us  to  select  the  single  disperser 
design  for  the  Phase  II  prototype. 

A  specific  DUV  design  is  shown  in  Figure  3,  which  uses  a  standard  4200  lines/mm 
grating  from  Richardson  gratings  and  custom  spherical  optics  (2  sets  of  4)  made  of  fused  silica 
and  calcium  fluoride,  two  glasses  that  have  high  transmission  in  the  DUV.  The  total  system 
footprint  is  75x100  mm  with  1”  optics  and  an  f/number  of  2.8  with  good  image  quality  over  a 
3x3  mm  field. 
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The  spot  diagram  of  the  lens  design  is  shown  in  Figure  4,  and  the  spot  radii  are  almost  all 
between  5  and  10  microns,  providing  adequate  optical  resolution  for  most  of  the  intensified  UV 
cameras  that  have  pixel  sizes  between  10  and  25  microns. 
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Figure  4  Spot  diagram  at  3  wavelengths  and  9  field  positions  ofDUV  CASSI  spectrograph 
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Signal  Processing: 

In  Phase  I,  we  developed  a  MATLAB  simulation  framework  to  model  the  proposed 
optical  architecture  and  test  reconstruction  procedures.  Our  model  allowed  us  to 

•  vary  the  size  of  the  focal  plane  array  and  explore  how  many  measurements  should  be 
necessary  to  achieve  a  given  level  of  reconstruction  accuracy; 

•  vary  the  number  of  multiplexed  dual  disperser  elements  to  explore  how  multiplexing 
impacted  the  tradeoff  between  spectral  and  spatial  resolution; 

•  vary  the  amount  of  photon  and  sensor  noise  contaminating  the  measurements;  and 

•  experiment  with  different  coding  masks. 

Our  first  task  was  to  develop  a  mathematical  model  relating  the  true  spectral  image  of  the  scene 
to  the  measurements,  which  would  be  collected  under  the  proposed  system  architecture.  In 
particular,  the  model  needed  to  be  flexible  enough  to  allow  us  to  simulate  how  different 
parameters  in  the  architecture  (i.e.  the  size  of  the  focal  plane  array,  the  number  of  dual  disperser 
elements,  the  amount  of  light  available,  and  the  selection  of  the  coding  masks)  might  impact 
performance.  From  a  linear  algebra  standpoint,  we  can  write  our  model  as  follows.  Let /be  a 
vectorized  representation  of  the  spectral  image,  so  that  if  the  spectral  image  is  x  n2X  ns,  then/ 
is  a  \ength-n jnsns  vector.  Let  j  be  the  measurements  collected  by  the  m-element  focal  plane  array 
and  stored  in  a  length-m  vector.  Then  we  have 


where  k  is  the  number  of  parallel  dual  disperser  elements.  Hi,  i  =  \,2,...,k,  are  the  operators 
describing  the  projections  of  /  onto  the  coding  mask  for  the  corresponding  dual  disperser 
system  and  subsampling  onto  the  FPA,  n  denotes  (Gaussian)  sensor  noise,  P  denotes  Poisson 
observations  (i.e.  photon  noise),  and  H  is  the  overall  system  operator  matrix. 

In  order  to  reconstruct  the  high-resolution  input  intensity  /  from  the  observations  y,  we 
developed  an  iterative  expectation-maximization  algorithm  based  on  state-of-the-art  multiscale 
methods  for  reconstruction  spectral  images. 

[E-step:]  ^  x 
[M-step:]  Compute  =  Denoise 

For  the  M-step,  we  performed  the  translation-invariant  denoising  approach  that  we  developed  to 
recover  spectral  image  intensities  from  Poisson  observations.  This  approach  is  based  on  the  key 
insight  that  the  spatial  boundaries  stay  the  same  in  every  spectral  band  even  though  the  photon 
flux  may  vary  with  every  spectral  band. 

For  our  numerical  experiments,  we  developed  a  test  spectral  image  based  on  the  spectra 
in^.  The  input  intensity  /  is  of  size  256x256x64  and  the  sum  (along  the  spectral  dimension) 
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through  the  test  input  spectral  image  appeared  as  in  Figure  5  a.  Two  of  the  spectra  from  this  test 
spectral  image  are  displayed  in  Figure  6  in  the  blue  plots.  Figure  5b  and  the  red  plots  in  Figure  6 
show  the  result  of  our  method  applied  to  a  simulated  system  with  16  parallel  dual  dispersers, 
each  with  a  unique  pseudo-random  coding  mask  and  mapping  to  a  64  x  64  region  of  the  focal 
plane  array. 


(a)  (b) 


Figure  5:  (a)  Spatial  variation  in  test  spectral  image,  computing  by  summing  intensity  across  all  spectral  bands,  (b)  Spectral 
image  estimate  computed  using  our  multiscale  EM  algorithm  for  the  proposed  Phase  I  architecture. 


Figure  6:  (a)  Target  spectrum  corresponding  the  white  diamond  shaped  target;  blue  plot  is  the  true  target  spectrum  and  the  red 
plot  is  the  estimate,  (b)  Target  spectrum  corresponding  the  gray  star  shaped  target;  blue  plot  is  the  true  target  spectrum  and  the 
red  plot  is  the  estimate. 


We  also  explored  how  performance  scaled  with  the  number  of  dual  disperser  systems,  k,  as 
shown  in  Figure  7.  In  this  experiment,  each  dual  disperser  element  mapped  to  a  64  x  64  region 
on  the  FPA,  so  more  dual  dispersers  implies  more  observations.  Thus  the  error  should  naturally 
decay  with  k,  though  after  A:=8  we  reach  a  point  of  diminishing  returns. 


Number  of  dual  dispersers  used 

Figure  7;  Reconstruction  error  as  a  function  of  the  number  of  parallel  dual  disperser  elements. 
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We  also  considered  holding  the  FPA  size  fixed  at  256  x  256,  and  then  varying  k,  so  that 
larger  k  implies  fewer  observations  per  dual  disperser  element.  We  considered  the  configurations 
displayed  in  Figure  8,  which  also  contains  the  reconstruction  errors  achieved  using  our 
algorithms. 


e  =  0.6853  £  =  0.7722 


Figure  8:  Reconstruction  errors  for  various  layouts  of  the  FPA  corresponding  to  different  configurations  of  parallel  dual 
disperser  systems. 

The  image  processing  that  is  an  integral  part  of  the  snapshot  Raman  Imager  must  be 
implemented  on  a  graphics  processing  unit  (GPU)  to  demonstrate  the  utility  of  the  imager  for 
field  applications.  We  have  developed  a  processing  algorithm  that  will  be  generated  in  standard 
Matlab  code  to  be  run  on  any  NVIDIA  CUDA-capable  GPU,  from  the  GeForce  8400  to  the 
Tesla  Cl 060. 

Related  Work 

Applied  Quantum  Technologies  designed,  built,  and  delivered  a  snapshot  multispectral 
short-wave  infrared  (SWIR)  camera  in  2008  to  a  leading  defense  contractor.  The  camera  was 
able  to  recover  10  spectral  bands  equally  spaced  from  1-1.7  microns  using  a  coded-aperture  and 
compressive  sampling  inference  algorithms.  An  optical  design  similar  to  what  will  be  the  starting 
point  for  the  proposed  design  was  used.  A  3-element  prism  provided  the  dispersion  for  the 
system,  and  off-the-shelf  lenses  were  used  in  the  spectrograph.  A  Goodrich  SWIR  camera  served 
as  the  detector  array.  The  system,  along  with  a  calibration  image  and  reconstructed  data-cube  is 
shown  in  Figure  9  The  main  issues  with  the  final  system  were  that  the  off-the-shelf  optics  were 
poorly  chromatically  corrected,  and  that  the  reconstruction  software  was  very  slow  (>1  minute). 
Both  of  these  issues  are  prime  focuses  of  the  Phase  I  design  effort. 
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200  400  600 


Figure  9  Upper-left-  assembled  SWIR  snapshot  multispectral  camera  system,  Upper  right-  calibration  image  from  detector 
array,  Bottom-  reconstructed  data-cube  of  outdoor  scene. 


AQT  has  also  recently  (2009)  delivered  a  prototype  long-wave-infrared  (LWIR)  coded- 
aperture  spectrometer  to  a  customer  for  remote  chemical  analysis.  The  customer  wanted  to 
replace  a  bulky  Fourier-Transform  Infrared  (FTIR)  system  with  a  dispersive  system  to  lower  the 
cost  and  size  of  the  instrument.  AQT  used  a  coded-aperture  to  increase  the  throughput  without 
sacrificing  resolution,  as  is  shown  in  the  comparison  between  the  coded-aperture  data  and  slit 
data  in  Figure  10.  A  near  real-time  software  interface,  also  shown,  was  developed  in  Labview 
that  was  able  to  process  the  imagery  from  the  camera  at  30  frames  per  second  with  a  lag  of  under 
1  second. 
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Figure  10  AQT's  Long-wave  Infrared  Coded  Aperture  Spectrometer,  Upper-left  Real-time  software  interface  providing  control, 
data  display,  and  data  storage.  Upper-right  Comparison  of  slit  (top  graph)  and  coded-aperture  (bottom  graph)  spectral  estimates 
of  the  transmission  spectrum  of  polystyrene.  Bottom-  Photographs  of  assembled  system. 


Dr.  David  Brady,  a  consultant  on  the  project,  is  investigating  multi-frame  analysis  of 
CASSI  systems  for  enhanced  resolution  capabilities.  This  will  allow  for  better  resolution  in  the 
spatial  and  spectral  dimensions,  and  allow  for  accurate  object  tracking  within  a  field  of  view. 
Multiple  frame  processing  is  based  on  slight  (pixel  level)  displacements  in  image  registration  due 
to  object  or  camera  motion  and  jitter.  Initial  studies  with  a  visible  CASSI  system  have 
demonstrated  that  datacube  estimation  using  just  a  few  frames  may  substantially  improve  image 
fidelity.  Figure  1 1,  as  an  example,  is  a  27  channel  CASSI  image  of  a  while  light-illuminated  leaf 
processed  using  5  frames  acquired  from  pixel-scale  camera  translation.  Figure  12  shows  raw 
CASSI  data  for  the  leaf  from  a  single  frame.  Dispersion  of  the  CASSI  code,  appearing  as  noise 
on  the  raw  data,  encodes  spectral  information  on  the  monochromatic  sensor  data.  Comparisons 
of  single  frame  and  five-frame  reconstructions  for  specific  wavelength  channels  are  shown  in 
Figure  12. 
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Figure  11  Reconstructed  data  cube  of  a  leaf  from  a  visible  range  CASSl  system 


As  illustrated  in  these  figures  estimation  of  spectral  images  from  the  space-time  image 
data  cube  improves  CASSl  spatial  resolution.  In  contrast  with  conventional  scanned  spectral 
imagers,  however,  CASSl  returns  a  full  data  cube  even  from  a  single  frame  and  allows 
incremental  and  adaptive  image  improvement  by  space-time  processing.  This  function  is 
particularly  important  in  applications  requiring  real-time  rapid  spectral  scanning,  and  the 
advances  by  Dr.  Brady’s  research  group  at  Duke  University  will  be  evaluated  for  possible 
integration  into  the  Phase  2  effort. 
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Figure  12:  (Left)  Raw  data  from  a  CASSI  image  of  a  leaf  (Middle)  Single  frame  reconstruction  at  one  spectral  channel  (Right)  5- 
frame  reconstruction  at  one  spectral  channel  using  multi-frame  processing 


The  Duke  signal  processing  team  has  performed  a  significant  body  of  research  intimately 
connected  to  the  research  described  in  this  proposal.  First,  we  have  established  fundamental 
performance  bounds  for  compressed  sensing  and  associated  optimization  algorithms'’'^  for 
image  reconstruction  from  photon-limited  compressive  measurements.  The  key  insight 
underlying  these  methods  was  that  conventional  CS  measurements  are  not  amenable  to  most 
optical  or  IR  systems  because  of  positivity  and  flux  preservation  constraints.  Unlike  most 
previous  work  in  CS,  we  considered  non-negative  projections,  limited  photon  counts,  Poisson 
noise  models,  and  limited  FPA  sizes.  Second,  we  have  studied  photon-limited  spectral  intensity 
estimation  and  proposed  a  spatially-  and  spectrally-adaptive,  nonparametric  method  to  estimate 
spectral  intensities  from  Poisson  observations".  Upper  bounds  on  the  error  of  our  estimator 
match  the  best  possible  lower  bound  up  to  a  log  factor  for  certain  degrees  of  spatial  and  spectral 
smoothness.  Finally,  we  have  developed  algorithms  to  exploit  inter-frame  correlations  in  video 

12  13 

data  for  improved  reconstruction  accuracy  and  speed.  ’ 


Bibliography 


'  M.  Gaft,  L.  Nagli,  “Standoff  laser-based  spectroscopy  for  explosives  detection,”  Proceedings  of 
the  SPIE,  Volume  6739,  pp.  673903  (2007). 

^  P.J.  Hendra,  C.  Jones,  G.  Warnes,  Fourier  Transform  Raman  Spectroscopy:  Instrumentation 
and  Chemical  Applications,  Ellis  Horwood,  Chichester,  UK,  1991.  Chapter  5,  pp.  90-126. 

^  Sedlacek  III,  A.J.;  Ray,  M.D.;  Higdon,  N.S.;  Richter,  D.A.  Short-range  noncontact  detection  of 
surface  contamination  using  Raman  lidar  Proc.  SPIE.  2001,  95,  4577. 

American  Society  for  Testing  and  Materials  (ASTM)  Terrestrial  Reference  Spectra  for 
Photovoltaic  Performance  Evaluation,  http://rredc.nrel.gOv/solar/spectra/aml.5/#refs 


21 


Final  Report  Contract  W91 1NF-09-C-0153 


Applied  Quantum  Technologies,  Inc. 


^  P.  J.  Treado,  M.  P.  Nelson,  R.  Schweitzer,  C.  Gardner,  and  R.  Wentworth,  "Standoff  Raman 
Hyperspectral  Imaging  Detection  of  Explosives,"  in  Laser  Applications  to  Chemical,  Security 
and  Environmental  Analysis,  2008. 

^  S.  Jafarpour,  R.  Willett,  M.  Raginsky,  and  R.  Calderbank.  “Performance  bounds  for  expander- 
based  compressed  sensing  in  the  presence  of  Poisson  noise”.  In  Forty-Third  Asilomar 
Conference  on  Signals,  Systems  and  Computers,  2009.  Winner  of  best  student  paper  award. 

’  M.  Raginsky,  Z.  T.  Harmany,  R.  F.  Marcia,  and  R.  Willett.  “Performance  bounds  for 
compressed  sensing  with  Poisson  noise”.  IEEE  Trans,  on  Signal  Proc.,  2009.  Submitted. 

*  R.  Willett  and  M.  Raginsky.  “Performance  bounds  for  compressed  sensing  with  Poisson  noise”. 
In  Proc.  of  IEEE  Int.  Symp.  on  Inf.  Theory,  2009. 

Z.  Harmany,  R.  Marcia,  and  R.  Willett.  “Sparse  Poisson  intensity  reconstruction  algorithms”.  In 
Proc.  IEEE  Workshop  on  Statistical  Signal  Processing,  2009. 

R.  Marcia,  R.  Willett,  and  Z.  Harmany.  “Compressive  optical  imaging:  Architectures  and 
algorithms”.  To  appear  in  Optical  and  Digital  Image  Processing  Eundamentals  and 
Applications,  edited  by  G.  Cristobal,  P.  Schelkens  and  H.  Thienpont,  2010. 

"  K.  Krishnamurthy,  M.  Raginsky,  and  R.  Willett.  “Multiscale  photon-limited  hyperspectral 
image  reconstruction,”  submitted  to  SIAM  Journal  on  Imaging  Sciences,  2010. 

R.  Marcia,  C.  Kim,  J.  Kim,  D.  Brady,  and  R.  Willett.  “Superimposed  video  disambiguation  for 
increased  field  of  view”.  Optics  Express,  vol.  16,  no.  31,  16352-16363. 

R.  Marcia  and  R.  Willett.  “Compressive  Coded  Aperture  Video  Reconstruction”,  European 
Signal  Processing  Conference  —  EUSIPCO  2008. 


22 


